Papers with document summarization
On Training Instance Selection for Few-Shot Neural Text Generation (2021.acl-short)
Copied to clipboard
| Challenge: | Pretraining large neural networks with a language modeling objective has led to dramatic improvements in text generation. |
| Approach: | They propose a selection strategy to select few-shot training instances based on unlabeled data to identify the most worthwhile data points that should be annotated under some budget of labeling cost. |
| Outcome: | The proposed strategy outperforms random sampling on three text generation tasks. |
Deep Bayesian Natural Language Processing (P19-4)
Copied to clipboard
| Challenge: | Introduction to deep Bayesian learning for natural language addresses the fundamentals of statistical models and neural networks. |
| Approach: | This tutorial addresses the advances in deep Bayesian learning for natural language . it focuses on advanced Bayessian models and deep models . authors present case studies and domain applications to tackle different issues . |
| Outcome: | This tutorial focuses on advanced Bayesian models and deep models for natural language . case studies and domain applications are presented to tackle different issues in deep Bayessian processing, learning and understanding. |
Block Diagram-to-Text: Understanding Block Diagram Images by Generating Natural Language Descriptors (2022.findings-aacl)
Copied to clipboard
| Challenge: | Block diagram summarization is a task that can be used to generate text from block diagrams. |
| Approach: | They propose a framework that converts block diagram images into text by extracting contextual meaning from the images in the form of triplets. |
| Outcome: | The proposed framework outperforms existing methods and techniques on a dataset of handwritten block diagrams. |
Tractable & Coherent Multi-Document Summarization: Discrete Optimization of Multiple Neural Modeling Streams via Integer Linear Programming (2022.emnlp-industry)
Copied to clipboard
| Challenge: | Multi-document summarization generates summary of corpus of documents consisting of related topics. |
| Approach: | They propose a generic framework to jointly consider coherence and informativeness in multi-document summarization and offers provisions to replace individual components based on the domain of source text. |
| Outcome: | The proposed framework consistently performs better than baselines for objective metrics and human evaluation. |
Evaluating the Effects of Embedding with Speaker Identity Information in Dialogue Summarization (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing methods for automatic dialogue summarization do not take into account speaker identity information, but instead use sinusoidal functions to embed speaker information at the less informative part of the position embedding. |
| Approach: | They propose to embed speaker identity information into a dialogue transcript encoder to address this issue and reduce the "who said what"-related errors. |
| Outcome: | The proposed method improves the convergence of the model in training and increases the average ROUGE scores of the generated summaries in comparison to existing methods. |
TracSum: A New Benchmark for Aspect-Based Summarization with Sentence-Level Traceability in Medical Domain (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing evidence-based summarization tasks require tracing source evidence to assess their accuracy. |
| Approach: | They propose a benchmark for traceable, aspect-based summarization that pairs summaries with sentence-level citations to enable users to trace back to the original context. |
| Outcome: | The proposed benchmark can be used to evaluate document summarization with LLMs and human evaluations. |
DiscoGraMS: Enhancing Movie Screen-Play Summarization using Movie Character-Aware Discourse Graph (2025.naacl-short)
Copied to clipboard
| Challenge: | Recent attempts at screenplay summarization focus on fine-tuning transformer-based pre-trained models, but these models often fall short in capturing long-term dependencies and latent relationships. |
| Approach: | They propose a novel resource that represents movie scripts as a movie character-aware discourse graph (CaD Graph) this resource aims to preserve all salient information, offering a more comprehensive and faithful representation of the screenplay’s content. |
| Outcome: | The proposed model preserves all salient information, offering a more comprehensive and faithful representation of the screenplay’s content. |
Multi-News: A Large-Scale Multi-Document Summarization Dataset and Abstractive Hierarchical Model (P19-1)
Copied to clipboard
| Challenge: | Multi-document summarization (MDS) of news articles has been limited to datasets of a couple of hundred examples. |
| Approach: | They propose a model which integrates a traditional extractive summarization model with a standard SDS model and achieves competitive results on MDS datasets. |
| Outcome: | The proposed model achieves competitive results on large-scale datasets. |
Globalizing BERT-based Transformer Architectures for Long Document Summarization (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing approaches to fine-tune a large language model on downstream tasks show several limitations when the target task requires to reason with long documents. |
| Approach: | They propose a hierarchical approach where the input is divided in multiple blocks independently processed by the scaled dot-attentions and combined between the successive layers. |
| Outcome: | The proposed approach performs well on three extractive summarization corpora of scientific papers and news articles. |
Provable Fast Greedy Compressive Summarization with Any Monotone Submodular Function (N18-1)
Copied to clipboard
| Challenge: | Submodular maximization with the greedy algorithm is an effective approach to extractive summarization. |
| Approach: | They propose a submodular maximization method that is 100 to 400 times faster than existing methods for extractive summarization. |
| Outcome: | The proposed method is 100 to 400 times faster than existing method based on integer-linear-programming formulations and achieves 95%-approximation. |
Improving Neural Abstractive Document Summarization with Explicit Information Selection Modeling (D18-1)
Copied to clipboard
| Challenge: | Existing neural abstractive methods for document summarization are not effective for document summary. |
| Approach: | They propose to extend basic neural encoding-decoding framework with an information selection layer to explicitly model and optimize the information selection process in abstractive document summarization. |
| Outcome: | The proposed model outperforms state-of-the-art methods on document summarization tasks significantly. |
MovieSum: An Abstractive Summarization Dataset for Movie Screenplays (2024.findings-acl)
Copied to clipboard
| Challenge: | Movie screenplay summarization requires an understanding of long input contexts and elements unique to movies. |
| Approach: | They propose a dataset for movie screenplay summarization that includes movie screenplayers accompanied by their Wikipedia plot summaries. |
| Outcome: | The proposed dataset includes 2200 movie screenplays accompanied by their Wikipedia plot summaries. |
On Sparsifying Encoder Outputs in Sequence-to-Sequence Models (2021.findings-acl)
Copied to clipboard
| Challenge: | Using sequence-to-sequence models, encoder outputs are usually transferred to the decoder for generation, but in this study, encoded outputs can be compressed to shorten the sequence for decoding. |
| Approach: | They propose to use a stochastic gate-based algorithm to mask encoder outputs to shorten the sequence delivered for decoding. |
| Outcome: | The proposed model can be used to shorten encoder outputs to short a sequence . the proposed model yields a speedup of up to 1.65 on document summarization and 1.20 on character-based machine translation tasks. |
LipKey: A Large-Scale News Dataset for Absent Keyphrases Generation and Abstractive Summarization (2022.coling-1)
Copied to clipboard
| Challenge: | Existing work has addressed each element individually, but this study focuses on LipKey, the largest news corpus with human-written abstractive summaries, absent keyphrases, and titles. |
| Approach: | They propose a novel news dataset that consists of highly absent keyphrases . they combine lips keyphrase and TF-IDF to obtain abstractive summaries . |
| Outcome: | The proposed dataset is the largest news corpus with human-written abstractive summaries, absent keyphrases, and titles. |
Subtopic-driven Multi-Document Summarization (D19-1)
Copied to clipboard
| Challenge: | Experimental results show that the proposed model outperforms state-of-the-art methods on benchmark datasets. |
| Approach: | They propose a multi-document summarization model that assumes a set of documents to be summarized is on the same topic. |
| Outcome: | The proposed model outperforms state-of-the-art methods on benchmark datasets. |
NonFactS: NonFactual Summary Generation for Factuality Evaluation in Document Summarization (2023.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained abstractive summarization models generate fluent summaries that are inconsistent with context document and contain nonfactual information. |
| Approach: | They propose a data generation model that synthesizes nonfactual summaries using human annotations. |
| Outcome: | The proposed model can generate nonfactual summaries and generalize to out-of-domain documents. |
Improving Neural Abstractive Document Summarization with Structural Regularization (D18-1)
Copied to clipboard
| Challenge: | Recent advances in document summarization fail to capture long-term structure of documents and multi-sentence summaries, resulting in information loss and repetitions. |
| Approach: | They propose to leverage structural information of documents and multi-sentence summaries to improve document summarization performance. |
| Outcome: | The proposed model outperforms state-of-the-art models on document summarization tasks. |
Long-Span Summarization via Local Attention and Content Selection (2021.acl-long)
Copied to clipboard
| Challenge: | Transformer-based models are state-of-the-art for a wide range of natural language processing tasks, including document summarization. |
| Approach: | They exploit large pre-trained transformer-based models and address long-span dependencies in abstractive summarization using two methods: local self-attention; and explicit content selection. |
| Outcome: | The proposed models achieve state-of-the-art on Spotify Podcast, arXiv, and PubMed datasets. |
HOLMS: Alternative Summary Evaluation with Large Language Models (2020.coling-main)
Copied to clipboard
| Challenge: | Efficient document summarization requires evaluation measures that can rank a set of systems based on an average score and highlight which individual summary is better than another. |
| Approach: | They propose a hybrid evaluation measure for document summarization called HOLMS that combines both language models pre-trained on large corpora and lexical similarity measures. |
| Outcome: | The proposed measure outperforms ROUGE and BLEU on several extractive summarization datasets for both linguistic quality and pyramid scores. |
An Anchor-Based Automatic Evaluation Metric for Document Summarization (2020.coling-main)
Copied to clipboard
| Challenge: | Existing reference-based evaluation metrics such as ROUGE have their own drawbacks. |
| Approach: | They propose a protocol for a reference-based automatic evaluation metric that requires the endorsement of source document. |
| Outcome: | The proposed metric is anchored on source document and has higher correlation with human judgments. |
View Dialogue in 2D: A Two-stream Model in Time-speaker Perspective for Dialogue Summarization and beyond (2022.coling-1)
Copied to clipboard
| Challenge: | Existing models for dialogue summarization focus on document summarizing on time and speaker-centered points, but this approach is limited in understanding the dialogue. |
| Approach: | They propose a 2D view of dialogue based on a time-speaker perspective where the time and speaker streams of dialogue can be obtained as strengthened input. |
| Outcome: | The proposed model outperforms existing models on the QMSum dataset and improves summary faithfulness and human evaluation. |
Enhancing Scientific Document Summarization with Research Community Perspective and Background Knowledge (2024.lrec-main)
Copied to clipboard
| Challenge: | Scientific paper summarization is the focus of recent research . prevailing summarizing methods involve selective extraction of content from abstract, introduction, and conclusion segments within the target articles. |
| Approach: | They propose a model that incorporates references and citations to capture the impact of the document on the research community. |
| Outcome: | The proposed model generates extractive and abstractive summaries in parallel and improves their performance when considering the standard metrics. |
HeterGraphLongSum: Heterogeneous Graph Neural Network with Passage Aggregation for Extractive Long Document Summarization (2022.coling-1)
Copied to clipboard
| Challenge: | Existing models for extractive document summarization are based on sequence-to-sequence (Seq2Sequency) but long-form document summaries using graph-based methods are still an open research issue. |
| Approach: | They propose a heterogeneous graph neural network model to improve the performance of extractive document summarization using graph-based methods. |
| Outcome: | The proposed model can achieve state-of-the-art performance without pre-trained language models. |
Text or Pixels? Evaluating Efficiency and Understanding of LLMs with Visual Text Inputs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | *visual text representations* are a practical and surprisingly effective form of input compression for decoder LLMs. |
| Approach: | They exploit visual representations to render long text inputs as a single image and provide it directly to the model. |
| Outcome: | The proposed method reduces token usage while preserving performance. |
Evaluating and Improving Factuality in Multimodal Abstractive Summarization (2022.emnlp-main)
Copied to clipboard
| Challenge: | Current factuality metrics do not account for vision modality, thus are not adequate for vision-and-language summarization. |
| Approach: | They propose a weighted combination of CLIPScore and BERTScore to evaluate factuality for abstractive document summarization. |
| Outcome: | The proposed metric outperforms existing factuality metrics on four factuity metric-evaluation benchmarks and is robust to human judgments. |
Sparsity and Sentence Structure in Encoder-Decoder Attention of Summarization Systems (2021.emnlp-main)
Copied to clipboard
| Challenge: | Training and inference using large transformer models can be computationally expensive because the self-attention's time and memory grow quadratically with sequence length. |
| Approach: | They propose a modified transformer architecture that constrains the encoder-decoder attention mechanism to a subset of input sentences while maintaining system performance. |
| Outcome: | The proposed architecture can be trained and inferenced using large transformer models with expensive training and induction costs. |
Improving Consistency for Text Summarization with Energy Functions (2023.findings-emnlp)
Copied to clipboard
Qi Zeng, Qingyu Yin, Zheng Li, Yifan Gao, Sreyashi Nag, Zhengyang Wang, Bing Yin, Heng Ji, Chao Zhang
| Challenge: | Current abstractive summarization models generate inconsistent content due to the inherently noisy dataset and the discrepancy between maximum likelihood estimation based training objectives and consistency measurements. |
| Approach: | They propose a new consistency taxonomy that categorizes inconsistent content into faithfulness, factuality, and self-supportiveness. |
| Outcome: | Experiments on XSUM and CNN/DM datasets show that EnergySum mitigates the trade-off between accuracy and consistency. |
E2LLM: Encoder Elongated Large Language Models for Long-Context Understanding and Reasoning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Considerable efforts have been and are still being put into increasing the context length of Large Language Models (LLMs) |
| Approach: | They propose an approach that divides long contexts into chunks, compresses each into soft prompts using a pretrained text encoder, and aligns these representations with a decoder-only LLM via an adapter. |
| Outcome: | The proposed approach outperforms 8 state-of-the-art methods in effectiveness and efficiency for document summarization and question answering, and achieves the best performance on LongBench v2 among models of comparable size. |